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SUMMARY 

The  considerable  potential  benefits  of  compatibility  checking  of  aircraft  dynamic 
flight  data  have  in  the  past  not  been  fully  realised  when  applied  to  real  data.  It  is  suggested 
in  this  report  that  this  is  partly  due  to  the  presence  of  errors  in  the  real  data  which  are  not 
usually  accounted  for  in  computer  simulation  studies.  When  factors  such  as  accelerometer 
offset  from  centre  of  gravity,  measurement  time  delays  and  other  non-linearities  are 
accounted  for,  good  results  can  be  achieved  with  moderate  quality  instrumentation.  The 
effect  of  these  factors  on  the  identified  instrument  errors  are  studied  in  this  report  and 
confidence  in  the  results  established  by  a  careful  comparison  with  instrument  calibrations 
and  expected  errors.  Other  considerations,  such  as  the  influence  of  manoeuvre  .shape  and 
the  inclusion  of  altitude  record,  are  also  discussed,  and  the  conditions  for  successful  appli¬ 
cation  of  compatibility  checking  techniques  to  flight  data  are  summarised.  The  importance 
of  understanding  the  instrumentation  .system  is  highlighted. 
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NOTATION 


A 


ax,  az 

btx,  btt,  bn  etc. 

g 

h 

i 

J 

N 

q 

R 

t 

U,  Vf 


V 

x,z 

Xa) 

X»,  Zs 
a 

A 

Aax>  A»i,  Aq  etc. 

V 


Subscripts 

a 

m 


Sensitivity  matrix,  equation  (7) 

Linear  accelerations  in  x,  z  directions,  m.  s~^ 

Offset  biases  in  az,  az,  q  etc.  measurements 
Gravitational  acceleration,  m.  s-^ 

Altitude 
Time  index 

Cost  functional  to  be  minimised,  equation  (5) 

Number  of  time  points 
Pitch  rate,  rad  s-^ 

Measurement  noise  matrix 
Time,  sec 

Velocities  in  x,  z  direction 
Airspeed,  m.  s“^ 

Reference  body  axes 

Body  axis  coordinates  of  angle  of  attack  probe,  m 
Accelerometer  position  relative  to  centre  of  gravity,  m 
Angle  of  attack,  rad 
Increment 

Scale  factor  error  in  ax,  az,  q  etc.  measurements 
Vector  of  residuals,  equation  (S) 

Pitch  attitude,  rad 
Parameter  vector,  equation  (4) 

Standard  deviation 


out 


Refers  to  accelerometer  location 
Measured  value 
Output  quantity 


1.  INTRODUCTION 

The  application  of  system  identification  methodology  to  the  extraction  of  aerodynamic 
information  from  flight  test  data  has  been  of  interest  to  the  Aircraft  Behaviour  Studies-Fixed 
Wing  group  at  Aeronautical  Research  Laboratories  (ARL)  for  a  number  of  years.  One  approach 
taken,  as  a  first  stage  in  the  analysis  of  the  data,  has  been  to  make  use  of  redundant  information 
available  in  the  quantities  measured  in  order  to  identify  and  remove  inconsistencies  in  the  measure¬ 
ments  caused  by  instrument  errors.  With  the  instrument  errors,  such  as  bias  and  scale  factor 
change,  properly  accounted  for,  excellent  agreement  between  calculated  and  measured  output 
time  histories  can  be  obtained. 

Programs  for  compatibility  checking  have  been  reported  by  a  number  of  authors  (Refs  1-8). 
Work  in  the  Aircraft  Behaviour  Studies  Group  was  summarised  in  Ref.  9  and  extended  further 
under  a  Research  Agreement  with  the  University  of  Newcastle  (Refs  10,  1 1).  While  very  satis¬ 
factory  results  using  this  approach  have  been  obtained  with  simulated  data  (Refs  9-11),  reported 
applications  to  real  data  obtained  during  flight  tests  have  not,  in  general,  been  very  convincing. 
A  possible  exception  is  the  work  reported  in  Ref.  3  which  uses  extremely  accurate  and  expensive 
instrumentation  where  expected  errors  are  in  any  case  very  small.  As  instrumentation  quality 
deteriorates,  good  results  become  more  difficult  to  achieve  but  the  challenge  remains  to  extract 
the  maximum  amount  of  information  from  flight  tests  of  limited  duration  with  instrumentation 
of  limited  quality,  as  typically  used  in  flight  testing. 

A  difficulty  encountered  when  applying  the  method  to  real  data  is  that,  although  excellent 
fits  can  be  achieved  between  calculated  and  measured  output  time  histories,  the  corresponding 
instrument  errors  extracted  take  on  unrealistic  values.  Possible  reasons  for  this  include  inadequate 
length  of  record,  neglect  of  sources  of  error  in  the  model  of  the  instrumentation  system,  and 
possible  time  delays  or  shifts  in  some  measurements.  In  particular,  the  effects  of  delay  in  airspeed 
measurements  and  the  effects  of  displacement  of  instruments  from  the  aircraft  centre  of  gravity 
are  discussed  in  Ref.  11.  Methods  for  making  allowance  for  accelerometer  offsets  from  the 
centre  of  gravity  and  for  determining  relative  time  shifts  in  measurement  channels  are  reported 
in  a  previous  note  (Ref.  12).  Even  with  these  taken  into  account,  the  question  of  credibility  of 
the  resulting  parameter  values  remains.  Specifically,  what  level  of  confidence  can  be  placed  in 
the  results  and,  in  particular,  can  the  level  be  quantified  ? 

The  above  question  can  be  particularly  answered  by  studying  the  consistency  of  results 
obtained  from  different  flight  records  and  for  varying  lengths  of  a  given  record.  Further,  the 
reasonableness  of  the  results  can  be  judged  against  a  knowledge  of  the  instrumentation  system 
and,  in  particular,  from  the  expected  range  of  errors  based  on  repeated  calibrations.  This  report 
sets  out  to  establish  thecredibility  of  the  results  using  the  above  considerations,  and  also  suggests  a 
possible  quantitative  measure  of  confidence  based  on  the  calculated  Cramer-Rao  bound.  In 
addition,  the  efiect  of  measurement  lags  on  extracted  instrument  parameters  is  documented, 
and  the  improvement  obtained  by  including  the  altitude  record  as  an  additional,  though  noisy, 
output  is  studied. 

The  theoretical  formulation  of  the  problem  and  a  brief  description  of  the  Maximum  Likeli¬ 
hood  approach  for  its  solution  is  discussed  in  Section  2  of  this  report.  Section  3  considers  the 
test  manoeuvres  flown  and  examines  the  instrumentation  and  data  acquisition  system.  Results 
obtained  from  application  of  the  compatibility  checking  program  to  the  measured  time  histories 
are  then  presented  and  analysed  in  Section  4,  and  the  report  concludes  with  a  discussion  of  some 
of  the  possible  implications  for  future  flight  test  investigations. 
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2.  THEORETICAL  BACKGROUND 

The  theoretical  formulations  of  the  current  approach,  based  on  the  aircraft  kinematic 
equations,  is  summarised  in  this  section  and  the  method  of  solution  using  a  maximum  likelihood 
technique  briefly  described. 


2.1  PMUen  Fomnlatioii 

The  flight  manoeuvres  to  be  analysed  involve  only  symmetric  aircraft  motions  so  that  only 
the  longitudinal  equations  need  be  considered.  The  set  of  non-linear  kinematic  equations  relating 
aircraft  displacements,  velocities  and  accelerations  with  reference  to  flat  earth  axes  and  written 
in  a  body  axis  system  (x,  z)  fixed  in  the  aircraft  are  as  follows: 


u=  —^H>+axs+^^Xs—4^a—gsmfi 
w  =  ^+az,+4xi+g^Zii+g  COS0 

h  =  u  sinfl— w  COS0 


where 


u,  w  are  linear  velocities  in  the  x,  z  directions 
0,  q  are  pitch  attitude  and  angular  rate 
axa,  flZa  are  accelerations  in  the  x,  z  directions  at  the  accelerometer  locations 
Xa,  Za  are  accelerometer  coordinates  relative  to  the  aircraft  centre  of  gravity 
g  is  the  gravitational  constant. 


The  set  of  equations  (1)  take  into  account  possible  offset  of  the  accelerometers  from  the 
aircraft  centre  of  gravity  (xa,  Za).  For  further  details  see  Ref.  12. 

In  applying  the  compatibility  checking  method,  values  of  axa,  aza  and  q  are  treated  as  inputs. 
Measured  values  of  these  quantities,  taken  to  be  free  of  random  noise,  are  assumed  to  be  subject 
to  systematic  bias  and  scale  factor  errors  modelled  as  follows: 

</Xa  =  (I  +Aax)  aXm+Aax  (2) 

with  similar  equations  for  aza  and  q.  In  equation  (2)  Aax  represents  the  scale  factor  error  and  ^ax 
the  bias  error  which  relate  the  measured  quantity,  axm,  to  the  true  value  axa.  Substitution  of 
equation  (2)  into  equation  ( I )  yields  a  set  of  non-linear  equations  with  scale  factors  and  biases 
as  unknown  parameters.  The  exactness  of  the  kinematic  equations  and  the  assumption  of  no 
noise  on  the  measured  inputs  means  that  the  state  equations  are  free  of  process  noise  and  an 
estimate  for  the  state  is  obtained  by  simple  integration. 

The  outputs,  obtained  from  the  state,  with  allowance  for  possible  scale  factor  and  bias  errors 
are  calculated  as  follows: 


Fout  =  (l-hAvKM’'  +  M’2)'^2  +  *v 
aoul  =  (1  +  A,) tan-*  [{yv~qx^)ju\Jrb^ 

0out  =  ( I  +  Ag)  0  +  b(i 
bout  =  ( I  +  Ah)  A  + 
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where  the  A’s  represent  scale  factor  errors  and  the  b'&  are  bias  errors  while  x„  (assumed  known) 
represents  the  distance  of  the  angle  of  attack  sensor  ahead  of  the  centre  of  gravity.  The  biases 
and  scale  factors  in  equations  (2)  and  (3)  are  estimated  by  optimising  the  match  between  the 
output  and  the  noisy  measurements.  The  full  set  of  parameters  estimated  also  includes  the  initial 
conditions  of  the  state.  The  only  exception  is  h(o)  which  is  obtained  by  an  average  over  the  first 
second  of  record.  Consequently,  the  h  equation  is  only  used  to  calculate  perturbations  about 
A(o),  and  can  be  assumed  to  be  zero.  The  full  parameter  vector  to  be  considered  is  thus, 

(  —  IA»x,  hax,  A»2,  b*z,  Aq,  bq.  Ay,  bv,  Aj,  fig, 

A«,  be.  Ah,  u(o),  Mp),  6{o),  Xq,  (4) 


2.2  Maximom  LikeHliood  Solution 

The  maximum  likelihood  estimator  sets  out  to  find  the  set  of  parameters  (Equation  (4))  for 
which  the  measured  values  of  the  outputs  would  be  the  most  likely  to  occur.  Ref.  1 1  shows  that 
this  is  equivalent  to  minimisation  of  the  cost  functional, 

N 

y(^,  R)  =  1 log  I  R  I  +  ^  2  «'T(f)  R'l  KO  (5) 

/=  1 

where  v(i)  is  the  vector  of  residuals,  i.e.  the  difference  between  measured  and  predicted  output, 
and  R  is  a  weighting  covariance  matrix.  An  estimate  for  R  is  given  by; 

N 

R  =  ^  2 

f  =  I 


With  R  given  by  equation  (6),  equation  (5)  is  minimised  with  respect  to  ^  using  a  modified 
Newton-Raphson  technique,  and  the  procedure  iterated  until  convergence.  For  zero  mean, 
independent,  Gaussian  measurement  noise  the  final  estimates  are  unbiased  and  efficient,  i.e.  the 
covariance  of  the  estimates  is  given  by  the  Cramer-Rao  lower  bound. 


(7) 


covariance  {f}  = 


N 

1 

/=  I 


AT(/)ft  I  A(/) 


where  the  elements  of  the  sensitivity  matrix.  A,  are  the  partial  derivatives  of  the  elements  of  the 
calculated  output  vector  (equation  (3))  with  respect  to  the  elements  of  the  parameter  vector, 
S  (equation  (4)).  Thus  for  18  parameters  and  4  outputs,  A  is  a  4  by  18  matrix.  Details  relating 
to  the  calculation  of  the  sensitivity  matrix  for  the  specific  problem  under  consideration  are  set 
out  in  Ref.  12. 


3.  FLIGHT  TRIALS  AND  DATA  ACQUISITION 

This  section  describes  the  flight  manoeuvres  under  examination  and  discusses  the  instru¬ 
mentation  and  data  acquisition  procedures.  In  particular,  instrumentation  calibrations  are 
examined  in  some  detail  with  the  object  of  assessing  the  range  of  systematic  errors  which  may  be 
reasonably  expected. 
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3.1  Manoemrre  Descri|itkNi  and  Instnnnentatioii 


Flight  data  were  obtained  on  an  opportunity  basis  during  a  performance  flight  test  program 
being  undertaken  by  the  RAAF  Aircraft  Research  and  Development  Unit  (ARDU)  at  Edinburgh, 
South  Australia.  The  manoeuvre  specified  for  the  current  investigation  was  a  roller-coaster  type 
involving  sequences  of  gradual  pull-ups  and  push-overs.  Initially,  relatively  short  test  durations 
(10-20  seconds)  were  specified  but  subsequent  analysis  indicated  that  longer  records  were  re¬ 
quired  in  order  to  obtain  reliable  results.  Two  manoeuvres  provided  total  record  lengths  of 
40  seconds  or  longer  and  these  were  chosen  for  detailed  analysis.  The  basic  features  of  the  manoeu¬ 
vres  are  summarised  in  Table  1  and  time  histories  are  shown  plotted  in  Figures  1  and  2. 


TABLE  1 


Manoeuvre  Details 


Manoeuvre  1 

Manoeuvre  2 

Nominal  Mach  No. 

0-65 

0-87 

Nominal  Altitude,  ft 

33,000 

33,000 

ax  range,  m/s^ 

0-64-1 -24 
(±0-05) 

0-07-0-99 

(±0-05) 

az  range,  m/s® 

-I9I-2-5 

(±0-05) 

-15-3-0-58 

(±0-05) 

q  range,  rad/s 

-0I6-0I7 
(±0  002) 

-0-022-0-067 

(±0-002) 

V  range,  m/s 

178-209 

(±1) 

261-283 

(±1) 

a  range,  rad 

0-0  20 
(±0-002) 

0-012-0-13 

(±0-002) 

0  range,  rad 

-0-37-0 -34 
(±0-002) 

-0-17-0-17 

(±0-002) 

h  range,  m 

9489-10,204 

(±8) 

9780-10,130 

(±8) 

Flight  test  instrumentation  included  a  pitch  rate  gyro,  pitch  attitude  gyro  and  accelero¬ 
meters  to  measure  normal  and  longitudinal  accelerations.  In  addition  true  airspeed  and  altitude 
were  recorded  from  the  Air  Data  Computer.  Finally,  angle  of  attack  was  measured  using  a 
specially  designed  nose  probe  fitted  with  a  hemispherical  head  5  port  flow  angle  sensor.  This 
probe  was  attached  to  the  standard  air  data  probe  fitted  to  the  aircraft. 

Figure  1  shows  the  input  (ax,  az  and  9)  and  output  ( V,  a,  0,  /i)  time  histories  for  Manoeuvre  I 
at  a  nominal  Mach  Number  of  0-65  and  altitude  of  33  000  ft,  while  Figure  2  shows  the  same 
information  for  Manoeuvre  2  at  Mach  Number  0-87  and  altitude  33  000  ft.  The  oscillatory 
nature  of  the  time  histories  in  Figure  I,  particularly  for  q  and  az,  is  due  to  the  aircraft  pitch 
dampers  being  turned  off  during  this  manoeuvre.  By  contrast  most  of  Manoeuvre  2  was  flown 


4 


with  dampers  on  resulting  in  much  smoother  records  until  approximately  41  seconds  when 
the  dampers  were  disengaged.  For  compatibility  checking  purposes  the  presence  or  absence  of 
dampers  appeared  to  make  very  little  difference  but  the  short  period  information  available  in 
Figure  1  may  be  useful  in  any  subsequent  analysis,  particularly  if  stability  derivatives  are  of 
interest. 

The  ranges  spanned  by  the  input  and  output  variables  in  the  course  of  the  manoeuvres 
(Table  1)  indicate  that  Manoeuvre  1  is  a  somewhat  more  aggressive  manoeuvre.  For  example, 
the  peak  to  peak  difference  in  normal  acceleration  is  almost  22  m/s^  for  Manoeuvre  1  and  only 
16  m/s^  for  Manoeuvre  2.  For  pitch  rates  the  ranges  are  0-33  rad/s  and  009 rad/s  respectively 
and  for  pitch  attitude  0-71  rad  and  0-34  rad  respectively.  Despite  this,  the  longitudinal  accelera¬ 
tion,  ax,  changes  by  a  greater  amount  in  Manoeuvre  2  (l  -06m/s^)  than  in  Manoeuvre  1 
(0-60  m/$^).  Both  these  values  are  rather  small  and  some  attempt  to  increase  longitudinal 
acceleration  may  be  worthwhile  if  longitudinal  parameters  are  of  particular  interest.  Also  shown 
in  Table  1  (in  brackets)  are  estimated  ‘noise'  levels  on  the  measurements,  based  on  noise  apparent 
on  the  records.  These  are  useful  for  making  initial  estimates  of  the  R  matrix  in  the  cost 
functional,  equation  (S). 


3.2  Preprocessing 

Flight  data  were  digitally  recorded  on  magnetic  tape  (12  bit  accuracy,  60  samples  per  second) 
using  ARDU’s  Aircraft  Flight  Test  Recording  and  Analysis  System  (AFTRAS — Ref.  14). 
Seven  track  copies  of  the  flight  tapes  provided  to  ARL  were  processed  as  described  in  Ref.  15 
to  provide  time  histories  of  the  chosen  channels  in  engineering  units.  Calibration  data  required 
for  the  conversions  were  obtained  by  ARDU  for  most  channels  and  the  information  provided 
on  the  tapes.  The  only  exception  was  the  flow-angle  sensor  calibrations  which  were  determined 
in  the  ARL  transonic  wind  tunnel. 

Pitch  acceleration,  q,  required  for  accelerometer  offset  corrections  (Eqn  I)  was  calculated 
by  numerical  differentiation  of  the  pitch  rate  records  using  a  recursive  least  squares  algorithm 
as  described  in  Ref.  12.  This  provided  satisfactory  q  time  histories  which  are  included  among 
the  plots  in  Figures  I  and  2.  Accelerometer  offsets  from  the  centre  rf  gravity,  estimated  for  given 
fuel  state,  were  x^  equal  to  -0- 1 1  m  and  -  0-12  m  for  Manoeuvres  I  and  2  respectively  and  Za 
equal  to  0  •  53  m  for  both  cases. 

Finally,  prior  to  application  of  the  compatibility  checking  program,  relative  phase  shifts 
in  the  measurement  channels  were  determined  as  described  in  Ref.  12  and  time  histories  shifted 
appropriately  to  bring  them  into  correct  alignment.  The  relative  time  shifts  (delays)  for  ax, 
az,  q  y,a  and  0  were  (in  units  of  1/60  second)  6,  12, 6,  28,  3,  8  respectively.  A  value  of  28  was  also 
assumed  for  the  altitude,  ft,  channel.  The  effects  of  variations  from  these  reference  values  on  the 
identified  parameters  will  be  considered  in  Section  4. 


3.3  Calibrations 

A  careful  evaluation  of  instrument  calibrations  provided  by  ARDU  was  made  in  order  to 
assess  which  parameters  needed  to  be  retained  in  the  parameter  vector  and  the  possible  range  of 
values  which  they  may  be  expected  to  take.  This  assessment  was  based  on  repeat  calibrations 
which  were  performed  over  the  two  or  three  months  during  which  the  main  trials  were  in  progress. 
Ft  is  assumed  that  changes  in  the  calibrations  are  an  indication  of  bias  and  scale  factor  errors 
which  can  be  expected. 

The  range  of  values  spanned  by  the  calibrations  is  shown  in  Figures  3  to  7,  and  Table  2 
summarises  the  maximum  variations  in  slope  obtained.  The  figures  also  indicate  the  range  covered 
by  respective  measurements  during  the  trials.  At  mid-range  a  shift  can  be  specified  which  would 
make  the  calibration  curves  agree  at  that  point,  and  is  an  indication  of  the  bias  likely  to  be  identi¬ 
fied  if  no  adjustment  slope  were  permitted.  This  figure  is  also  given  in  Table  2. 
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Measurement 

Slope  variation,  % 

Bias 

acceleration,  az 

4-3 

3  m/s* 

pitch  rate,  g 

26-4 

0-02  rad/s 

airspeed,  V 

1-2 

10  m/s 

pitch  attitude,  0 

11-7 

0  07  rad 

altitude,  h 

29-3 

— 

The  slope  variation  and  bias  for  az  indicated  in  Table  2  appear  to  be  excessive  considering 
the  accuracy  generally  expected  of  accelerometers.  Similar  variations  were  not  found  in  the  ax 
and  ay  accelerometers.  For  example,  in  repeat  calibrations  of  the  ay  accelerometer  the  slope 
changed  by  only  0-3%  and  the  mid-range  shift,  or  bias,  was  less  than  0  01  m/s^.  It  5«  concluded 
that  the  az  accelerometer  readings  are  likely  to  be  subject  to  uncharacteristically  large  errors. 
Nevertheless,  inspection  of  Figure  3  shows  that,  over  the  relatively  small  range  covered  in  the 
trials,  a  simple  shift  is  sufficient  to  bring  the  two  curves  into  reasonable  agreement.  Ignoring 
the  slope  change  will  lead  to  an  error  of  0-4  m/s^  maximum  at  the  extremities  of  the  range. 

The  pitch  rate  gyro  calibrations  show  a  very  large  slope  change  w  hich  cannot  be  ignored 
over  the  range  covered  in  the  trials.  The  slope  discrepancy  was  biought  to  light  by  calibrations 
using  diffierent  calibration  equipment  and  suggests  that  at  least  one  of  the  turntables  used  pro¬ 
duced  erroneous  results.  Because  of  this  both  bias  and  scale  factor  errors  have  to  be  represented 
in  the  compatibility  checking  process.  Similarly,  fairly  large  scale  factor  errors  can  be  antici¬ 
pated  in  the  pitch  attitude  measurements  (Fig.  6). 

The  airspeed  calibrations  (Fig.  5)  show  a  very  small  change  in  slope  but  large  bias  errors 
appear  possible.  On  the  other  hand  the  altitude  calibrations  in  Figure  7  imply  the  possibility  of 
large  slope  errors.  Both  airspeed  and  altitude  measurements  may  be  subject  to  position  errors 
which  are  functions  of  Mach  number  (M),  due  for  example  to  changing  interference  patterns 
with  M  between  the  standard  aircraft  probe  and  the  adjacent  hemispherical  probe.  Curves 
for  pressure  error  correction  (PEC)  to  altitude  were  supplied  by  ARDU  and  are  shown  in  Figure  8. 
For  manoeuvre  1  centred  at  A/  =  0-65  the  pressure  error  correction  is  relatively  small  and  does 
not  vary  greatly  with  M.  At  most,  the  approximately  linear  variation  between  M  =  0  •  6  and  0  •  7 
would  appear  as  an  apparent  slope  error.  Ah,  in  the  altitude  calibration.  On  the  other  hand, 
for  manoeuvre  2,  centred  at  A/  =  0-87,  the  correction  may  be  quite  large  and  varies  non-linearly 
with  M.  The  effects  of  neglecting  pressure  error  corrections  may  be  significant  in  this  case  and 
will  be  considered  further  in  the  next  section.  An  equivalent  correction  curve  for  airspeed  was 
unfortunately  not  provided  but,  assuming  that  static  pressure  errors  can  be  related  to  airspeed 
errors  through  the  compressible  Bernouilli  equation,  a  correction  curve  can  be  inferred  and  will 
have  broadly  similar  characteristics  to  the  curve  in  Figure  8. 

The  angle  of  attack  sensor  was  calibrated  in  the  ARL  transonic  wind  tunnel  and  no  attempt 
was  made  at  in-flight  calibrations.  Consequently,  large  zero  offsets  can,  in  general,  be  expected 
due  to  flow  upwash  effects  ahead  of  the  aircraft.  Similarly,  it  cannot  be  assumed  that  the  slope 
of  the  calibration  curve  will  be  the  same  in  flight  as  in  the  wind  tunnel. 

In  summary,  consideration  of  instrumentation  calibrations  has  provided  some  feel  for  the 
magnitude  of  bias  and  scale  factor  errors  to  be  expected.  In  particular,  it  is  clear  that  scale  factor 
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errors  can  be  significant  in  many  of  the  channels  and  must  be  accounted  for.  Only  Asx  and  Aaz 
can  be  neglected  with  some  confidence.  Table  2  suggests  that  Av  is  also  likely  to  be  small,  but 
the  effects  of  pressure  error  correction  especially  over  the  Mach  number  range  of  manoeuvre  2 
suggests  that  Av  must  be  retained,  at  least  for  that  case. 


4.  RESULTS 

In  this  section  the  results  from  application  of  the  compatibility  checking  program  to  the 
flight  data  are  presented  and  discussed.  The  unknown  parameter  vector  (Eqn  4)  in  general 
contained  all  possible  bias  and  scale  factor  errors  with  the  exception  of  Aax  and  A^z  as  discussed 
in  the  previous  section.  Initial  conditions  were  also  identified  but  the  effects  of  accelerometer 
offsets  xa,  Za  Were  found  to  be  negligible  due  to  the  relatively  mild  manoeuvres,  and  consequently 
they  have  been  excluded  fr'^m  the  parameter  vector.  Initial  values  for  the  elements  of  the  weight¬ 
ing  matrix  R  were  ba.  ed  oi;  le  measurement  ‘noise’  levels  of  Table  I,  i.e.  the  diagonal  elements 
were  set  equal  to  thf  ...luare  of  the  appropriate  ‘noise’  level.  The  complete  set  of  measurements 
(Eqn  3)  was  used  in  general.  Typical  CPU  time  on  the  DECsystem-IO  was  about  65  minutes 
for  10  iterations  with  a  record  length  of  40  seconds. 


4.1  Manoeuvre  1  Results 

These  are  summarised  in  Tables  3  and  4  and  include  the  effects  of  variation  in  record  length, 
changes  in  parameter  vector  and  measurement  vector,  and  relative  measurement  time  shifts, 
to  be  discussed  in  turn  below.  Following  this,  the  scatter  in  results  will  be  examined  in  closer 
detail. 


4.1.1  Record  Length 

The  first  three  runs  in  Table  3  compare  the  results  obtained  with  record  lengths  of  40,  50 
and  60  seconds  respectively.  In  all  cases  excellent  matches  were  obtained  with  the  measured  and 
calculated  output  histories  being  almost  indistinguishable.  The  identified  parameter  values  are 
very  consistant,  with  the  possible  exception  of  6v  and  u((?)  which  show  significant  change  with 
increasing  record  length.  At  the  same  time,  the  estimated  standard  deviations  for  by  and  u(o) 
show  some  decrease.  The  scale  factor  errors  A,,  A,  and  A»  although  showing  some  variation 
with  record  length  are  in  all  cases  small.  The  rms  fit  errors  are  also  in  reasonable  agreement 
with  the  ‘noise’  on  the  measurements  as  given  in  Table  1. 


4.1.2  Change  in  Parameter  and  Measurement  Vectors 

Because  of  the  small  values  obtained  for  A,.  A,  and  A„  in  4.1.1  some  computer  runs  were 
carried  out  with  their  values  set  to  zero.  The  reduction  in  the  number  of  parameters  to  be  ex¬ 
tracted  not  only  leads  to  a  reduction  in  CPU  time  but  eases  the  demands  on  the  identification 
algorithm  thereby  leading  to  improvements  in  the  standard  deviations  of  the  estimates  as  shown 
in  runs  4  and  5  of  Table  3.  This  is  particularly  true  for  by.  u(o)  and  A,,  compared  with  runs  I  to  3. 
At  the  same  time  general  consistency  in  results  for  record  lengths  of  40  seconds  (Run  4)  and 
60  seconds  (Run  5)  is  further  improved. 
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Results  from  Manoeuvre  1 


The  effect  of  removing  the  altitude  history  from  the  records  to  be  matched  is  shown  in  run  6 
of  Table  3.  Comparison  of  run  6  with  run  5  shows  that  the  principal  difference  is  significant 
change  in  the  values  of  0(p),  b$  and  btx  together  with  a  deterioration  in  their  accuracy  as  indicated 
by  the  estimated  standard  deviations.  This  result  is  not  surprising  since  altitude  changes  imply 
considerable  information  about  0  which  in  turn  influences  ax,  as  can  be  seen  on  examination 
of  the  first  and  last  of  equations  (1).  Consequently  even  relatively  inaccurate  measurement  of 
altitude  provides  valuable  information  for  several  parameters  which  may  be  of  interest.  The 
inclusion  of  altitude  record  is  worthwhile  even  if  significant  scale  factor  error,  An,  is  uncorrected. 
This  can  be  seen  in  Table  4  by  comparing  run  7,  where  An  is  fixed  at  zero,  with  run  5  (repeated 
from  Table  3). 


4.1  J  Time  SUfis 

Runs  8  and  9  in  Table  4  demonstrate  the  effects  of  relative  time  shifts  (delays)  in  the  az 
and  V  records  showing  the  errors  likely  to  be  introduced  if  time  shifts  have  not  been  accounted 
for  correctly.  In  particular,  the  method  used  to  determine  time  shifts  in  the  records  (Ref.  12), 
is  least  accurate  for  az  and  V  shifts.  In  run  8  the  az  shift  (delay)  is  changed  from  12  units  (i.e. 
12/60  seconds)  to  0  units.  Thus  instead  of  lagging  the  q  record  by  0  - 1  second  it  now  leads  by  the 
same  amount.  The  only  significant  change  is  in  hu  which  has  changed  to  —0-033  from  — 0  -  lOS 
in  run  7.  As  expected  there  is  also  some  deterioration  in  the  rms  fit  errors,  particularly  in  the  a. 
record.  In  run  9  the  V  delay  has  been  increased  from  28  units  to  32  units,  i.e.  22/60  second  to 
46/60  second  with  respect  to  the  q  record.  Several  parameters,  shown  underlined,  have  suffered 
significant  changes  compared  to  run  7.  Of  most  concern  is  the  large  effect  on  6,,  since  accurate 
records  of  a  are  likely  to  be  of  importance  in  any  subsequent  analysis.  The  expected  deterioration 
in  the  rms  fit  for  y  is  also  apparent.  These  results  show  the  importance  of  accounting  for  time 
shift  in  airspeed  measurements  particularly  in  view  of  the  large  value  it  commonly  takes. 


4.1.4  Scatter  of  Results 

Figure  9  summarises  graphically  the  scatter  in  the  extracted  values  of  several  parameters 
as  obtained  in  runs  I  to  5  (Table  3).  The  scatter  band  is  compared  (in  brackets)  with  the  largest 
estimated  standard  deviation,  multiplied  by  a  factor  of  20,  from  Table  3.  In  general  this  provides 
a  reasonable  estimate  of  the  scatter,  with  the  exception  of  Ah  where  the  scatter  would  be  over¬ 
estimated  by  a  factor  of  7  or  8.  In  part  Justification  of  the  factor  of  20  it  should  be  noted  that 
neglect  of  process  noise  in  the  maximum  likelihood  algorithm  was  found,  in  Ref.  16  using  simu¬ 
lated  data,  to  lead  to  an  underestimate  of  the  scatter  by  a  factor  of  approximately  3  to  3  depending 
on  noise  levels.  With  real  data,  a  further  underestimation  can  be  expected  associated  with  the 
limited  bandwidth  of  the  measurement  noises.  This  effect  is  discussed  in  detail  in  Ref.  17,  which 
reports  a  typical  empirical  factor  of  3-10  required  to  bring  the  estimated  standard  deviations 
into  line  with  the  observed  scatter  of  the  parameter  estimates.  These  two  effects  combine  to 
give  the  present  factor  of  about  20  on  the  estimated  standard  deviations  required  to  produce  a 
reasonable  indication  of  the  level  of  confidence  in  the  results. 

Looking  more  closely  at  the  identified  errors  Ay  and  by  in  the  airspeed  calibrations.  Figure  10 
plots  the  relation  between  measured  and  true  airspeeds  as  implied  by  the  values  of  Ay  and  by 
obtained  in  runs  1,  2,  3  and  3  (Table  3).  Thus,  although  the  scatter  in  by  is  about  ±  14  m/s 
(Fig.  9)  the  actual  scatter  in  airspeed  over  the  range  covered  in  the  trials  is  somewhat  less  at 
around  ±  8  m/s  (see  also  u(o)  in  Figure  9). 
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4^  MuMCtme  2  RmmUs 

The  results  for  manoeuvre  2,  all  of  which  relate  to  a  record  length  of  50  seconds,  are 
summarised  in  Table  S.  In  run  1  all  the  relevant  parameters  were  identified  but  pressure  error 
corrections  (PEC),  discussed  in  3.3  were  not  applied.  The  results  are  in  general  consistent  with 
those  obtained  from  manoeuvre  1,  taking  into  account  the  possible  range  of  calibration  errors 
previously  discussed.  The  most  notable  exceptions  are  At  and  bv  which  take  on  very  large  values, 
but  combine  with  one  another  in  such  a  way  that,  over  the  range  of  interest,  the  calculated  air¬ 
speed  magnitudes  are  not  very  different  from  those  measured.  Nevertheless,  these  large  values 
point  to  the  possibility  of  some  unmodelled  factor  in  the  airspeed  calibration. 

The  effect  of  ne^ecting  A,  and  A«,  which,  although  larger  than  for  manoeuvre  1,  are  still 
relatively  small,  is  shown  in  the  run  2  results  of  Table  5.  In  general  there  is  little  change  compared 
with  run  1  results.  Some  improvement  in  the  estimated  standard  deviations  of  Aq  and  u(o)  is 
apparent  and  the  values  of  these  parameters  also  change  slightly,  together  with  a  more  notable 
change  in  the  values  of  At  and  by. 

The  remaining  columns  in  Table  5  show  the  effects  of  including  pressure  error  corrections 
(PEC)  in  the  airspeed  record  (run  3)  and  also  the  altitude  record  (run  4)  as  described  in  3.3. 
The  most  significant  effect  in  run  3  is  the  large  change  in  the  values  of  At  and  by  which  now  take 
on  much  smaller  values  than  previously.  This,  together  with  the  improvement  in  the  airspeed 
rms  fit  error,  indicates  the  importance  of  making  allowance  for  the  non-linear  PEC  at  transonic 
Mach  numbers.  Parameters  other  than  At  and  by  are,  fortunately,  only  slightly  changed.  Finally, 
the  inclusion  of  PEC  in  the  altitude  measurements  influences  only  An  in  any  significant  way. 
The  value  of  Ah  in  run  3  has  reversed  sign  in  run  4  suggesting  the  possibility  of  an  overcorrection. 


4.3  Sammary  of  Results 

A  summary  of  the  results  of  this  investigation,  including  a  comparison  of  manoeuvre  1  and 
manoeuvre  2  parameters,  is  shown  in  Table  6.  The  values  are  selected  from  Tables  3  and  5  and 
correspond  broadly  to  the  lowest  estimated  standard  deviations  and  thus  represent  the  values 
with  the  highest  level  of  confidence.  The  error  ranges  indicated  in  Table  6  are  in  fact  20  times  the 


TABLE  6 


Summary  of  Extracted  Parametm 


Parameter 

Manoeuvre  1 

Manoeuvre  2 

b„,  m/s* 

-013±007 

-017±007 

h»i,  m/s* 

-115±002 

-1I4±002 

Aq 

-0-21  ±0  004 

-0-20±  0  006 

hq,  rad/s 

-0  028±  0  0002. 

-0  024±  0  002 

At 

-0  026  ±0  02 

— 

by,  m/s 

-l-4±2 

— 

Aa 

0013±002 

-0  075±002 

ba,  rad 

0  055  ±  0  006 

0  05010  006 

A« 

-0  028  ±002 

-0  04410  02 

be,  rad 

-0  04±0-007 

0  01010  006 

Ah 

-010±002 

— 

u(o),  m/s 

204  +2 

27413 

w(o).  m/s 

18-4±1 

7-512 

e(p),  m/s 

013±  0  007 

0  007  1  0  007 

w  ' 
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estinuted  standard  deviations,  as  discussed  in  4.1.4.  Despite  the  differences  in  the  two 
manoeuvres  the  error  confidence  bands  are  very  similar. 

The  parameter  values  obtained  are  also  very  consistent  between  the  two  manoeuvres,  with 
the  exception  of  bg  and  leaving  out  the  airspeed  and  height  parameters  in  manoeuvre  2,  which 
are  affected  by  significant  pressure  error  corrections,  as  discussed  in  4.2.  Comparison  of  the 
confidence  bands  with  extracted  parameter  values  leads  to  the  following  observations.: 


(a)  Several  parameters,  e.g.  hu,  Aq,  hq  are  significantly  different  from  zero  and  very 
accurately  determined. 

(h)  The  parameters  hu,  ha  and  bg  appear  to  be  reasonably  accurately  determined  and  also 
non-zero.  In  particular  h,  indicates  a  bias  error  of  close  to  3°  in  angle  of  attack  measure¬ 
ments.  However,  note  the  effect  of  time  shift  in  the  V  measurement  on  these  parameters 
(4.1.3). 

(c)  hv,  Av,  A,  and  Xg  in  manoeuvre  1  are  not  significantly  different  from  zero.  Consequently, 
the  error  in  V  measurement  is  not  significantly  different  from  zero.  In  particular  the 
initial  airspeed  (u^(o) + %  204-8  m/s  compares  with  the  measured  initial 
airspeed  of  202-6  m/s.  As  a  matter  of  interest,  the  respective  values  for  manoeuvre  2 
are  274-1  m/s  and  267-1  m/s,  but  PEC  complicates  the  comparison  in  this  case. 


Finally,  it  is  notable  that  the  extracted  parameter  values  in  Table  6  are  consistent  with  the 
possible  calibration  errors  discussed  in  3.3.  In  particular,  the  large  values  of  haz  and  Aq  confirm 
the  calibration  difficulties  encountered  with  the  respective  transducers,  which  are  not  normally 
expected  to  be  subject  to  large  error. 


S.  CONCLUDING  REMARKS 

The  application  of  compatibility  checking  techniques  to  dynamic  flight  data  measurements, 
as  described  in  this  report,  has  the  potential  to  address  a  range  of  problems  which  may  arise  when 
trying  to  extract  aerodynamic  information  from  flight  data.  For  example,  while  stability  and 
control  testing  usually  only  requires  measurement  of  perturbations  relative  to  some  reference 
state,  there  are  occasions  when  absolute  measurement  accuracies  are  required  over  a  wide  range 
of  operating  conditions,  e.g.  Drag  as  a  function  of  angle  of  attack  in  performance  testing.  In 
other  cases  measurements  may  be  so  inaccurate  as  to  be  unusable,  e.g.  airspeed  and  angles  of 
attack  and  sideslip  in  a  spinning  manoeuvre.  The  possibility  of  reconstructing  these  from 
accurate  (corrected)  inertial  measurements  is  very  attractive.  Again,  when  linear  representation 
of  the  aerodynamic  forces  and  moments  as  functions  of  the  independent  variables,  via  the  aero¬ 
dynamic  derivatives,  is  not  possible,  as  in  high  angle  of  attack  manoeuvres,  it  may  be  more 
desirable  to  obtain  the  absolute  values  of  the  forces,  moments  and  independent  variables  and,  as 
a  second  stage,  seek  to  establish  the  functional  relationship. 

Compatibility  checking  opens  up  the  possibility  of  analysing  data  effectively  in  all  these 
circumstances  and  successful  implementation  of  this  approach  to  real  data  offers  great  potential 
benefits.  A  previous  report  considered  factors  likely  to  arise  in  flight  data  and  not  usually  con¬ 
sidered  in  computer  simulation  studies.  These  factors,  such  as  accelerometer  offset  from  the 
centre  of  gravity,  measurement  time  delays  and  so  on  can  have  considerable  impact  on  the  results, 
and  methods  were  devised  to  take  them  into  account  in  the  compatibility  checking  process. 
The  current  report  follows  on  by  looking  in  detail  at  the  identified  instrument  parameters  and 
attempting  to  establish  a  degree  of  confidence  in  the  values  obtained.  This  has  been  achieved, 
partly  by  a  careful  study  of  the  characteristics  of  the  instrumentation  system  and  calibration 
curves,  thereby  establishing  a  possible  range  of  errors,  followed  by  a  comparison  of  the  identified 
errors  with  this  expected  range.  Secondly,  the  consistency  of  the  results  from  the  two  flight  records 


analysed  and  from  varying  record  lengths,  has  added  to  the  overall  confidence.  Further,  the 
Cramer-Rao  bound,  multiplied  by  a  factor  of  20,  appears  to  give  a  reasonable  quantitative 
measure  of  the  scatter  of  the  results  and  can  be  used  as  an  indication  of  the  accuracy  with  which 
individual  parameters  are  extracted. 

In  order  to  obtain  consistent  results  for  all  parameters,  particularly  airspeed  errors,  it  has 
been  found  necessary  to  use  record  lengths  of  the  order  of  40  seconds  or  more.  This  contrasts 
with  typical  record  lengths  of  S  to  10  seconds  for  stability  and  control  testing.  At  the  same  time, 
the  altitude  record,  even  though  subject  to  fairly  large  systematic  and  random  errors,  was  found 
to  contain  information  useful  for  coping  with  the  correlation  between  some  parameters,  namely 
hue,  and  0(o).  The  present  study  has  brought  out  the  importance  of  understanding  the  instru¬ 
mentation  system  and  of  making  allowance  for  sources  of  error  other  than  simple  bias  and  scale 
factor.  As  well  as  accounting  for  centre  of  gravity  offset  and  measurement  time  delays,  particu¬ 
larly  in  airspeed,  this  report  has  considered  the  effects  of  airspeed  and  altitude  pressure  error 
corrections  which  introduce  significant  non-linearities  for  Mach  numbers  in  the  transonic  range. 
The  important  effect  which  delay  in  the  airspeed  measurement  has  on  several  parameters  suggests 
that  it  may  be  worth  putting  some  effort  into  attempting  to  model  the  delay,  perhaps  as  a  simple 
first  order  lag,  and  then  identify  it  as  an  additional  parameter. 

The  two  manoeuvres  analysed  differed  significantly  in  the  amount  of  short  period  dynamics 
present  but,  so  far  as  the  compatibility  checking  algorithm  was  concerned,  no  differences  were 
found  in  identifying  the  systematic  errors.  Hence  the  manoeuvre  shape  can  be  chosen  to  reflect 
the  overall  aims  of  the  flight  trials.  For  example,  for  performance  testing,  a  smooth  (small 
pitch  rate)  roller  coaster  type  of  manoeuvre  covering  a  wide  angle  of  attack  range  with  relatively 
large  longitudinal  accelerations  may  be  desirable.  On  the  other  hand,  for  stability  and  control 
information,  larger  excursions  in  angular  rates  would  be  required.  Since  simple  pulse  or  doublet 
responses  are  no  longer  essential,  the  opportunity  exists  to  separate  out  linear  acceleration  and 
rate  derivatives.  For  centre  of  gravity  determination  accurate  results  would  only  be  obtained 
with  a  fairly  vigorous  (high  pitch  acceleration)  manoeuvre.  This  has  yet  to  be  tested  with  flight 
data.  A  combination  of  several  types  of  manoeuvre  types  may  be  devised  to  suit  the  purpose 
at  hand.  Clearly  the  availability  of  compatibility  checking  procedures  raises  a  number  of  new 
aspects  for  consideration  when  planning  flight  trials.  The  current  study  indicates  that,  with 
proper  care  and  planning,  compatibility  checking  can  be  applied  with  success  to  flight  data 
obtained  with  moderate  quality  instrumentation. 
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